Using Model-Driven Bundle-Adjustment to Model Heads from Raw Video Sequences
نویسنده
چکیده
We show that we can effectively and automatically fit a complex facial animation model to uncalibrated image sequences. Our approach is based on model-driven bundleadjustment followed by least-squares fitting. It takes advantage of three complementary sources of information: stereo data, silhouette edges and 2–D feature points. In this way, complete head models can be acquired with a cheap and entirely passive sensor, such as an ordinary video camera. They can then be fed to existing animation software to produce synthetic sequences.
منابع مشابه
Modeling Heads from Uncalibrated Video Sequences
We show that we can e ectively t a very complex facial animation model to uncalibrated video sequences, without bene t of targets, structured light or any other active device. Our approach is based on regularized bundle-adjustment followed by least-squares minimization using a set of progressively ner control triangulations. It takes advantage of three complementary sources of information: ster...
متن کاملBundle Adjustment for Stereoscopic 3D
The recent resurgence of stereoscopic 3D films has triggered a high demand for post-processing tools for stereoscopic image sequences. Camera motion estimation, also known as structure-from-motion (SfM) or match-moving, is an essential step in the post-processing pipeline. In order to ensure a high accuracy of the estimated camera parameters, a bundle adjustment algorithm should be employed. We...
متن کاملRobust identification and matching of fiducial points for the reconstruction of 3D human faces from raw video sequences
We describe an algorithm for the automatic features detection in 2D color images of either frontal or rotated human faces. Such features allow to initialize robustly a bundle-adjustment in order to fit a generic 3D face model to the images. The algorithm first identifies the sub-images containing each feature (eyes, nose and lips), afterwards, it processes them separately to extract fiducial po...
متن کاملAdaptive Spectral Separation Two Layer Coding with Error Concealment for Cell Loss Resilience
This paper addresses the issue of cell loss and its consequent effect on video quality in a packet video system, and examines possible compensative measures. In the system's enconder, adaptive spectral separation is used to develop a two-layer coding scheme comprising a high priority layer to carry essential video data and a low priority layer with data to enhance the video image. A two-step er...
متن کاملPropagations d’erreur pour l’ajustement de faisceaux local Error Propagations for Local Bundle Adjusment
Local bundle adjustment (LBA) has recently been introduced to estimate the geometry of image sequences taken by a calibrated camera. Its advantage over standard (global) bundle adjustment is a great reduction of computational complexity, which allows real-time performances with a similar accuracy. However, no confidence measure on the LBA result such as uncertainty or covariance has yet been in...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999